More-Or-Less Elicitation (MOLE) 1 Running head: MORE-OR-LESS ELICITATION (MOLE) More-Or-Less Elicitation (MOLE): Improving the Accuracy and Calibration of Estimates

نویسندگان

  • Matthew B. Welsh
  • Michael D. Lee
  • Steve H. Begg
چکیده

Eliciting numerical estimates from people is a central challenge for psychology. Cognitive biases can affect estimates, making it challenging to measure what people know or believe. We present a novel elicitation method, More-Or-Less Elicitation (MOLE) that, rather than having people make a single, absolute judgment, asks for repeated, relative judgments across the range of possible estimates and constructs a probability density function (PDF) representing their beliefs. Study 1 uses a perceptual estimation task to compare these PDFs with traditionally elicited ranges, concluding that MOLE improves accuracy and precision. Study 2 shows that, compared to alternate, repeated-judgment methods, MOLE takes less time and does not require distractors. Study 3 shows MOLE’s efficacy in eliciting answers to general knowledge questions. We argue that MOLE benefits from using relative rather than absolute questions, avoids problems usually associated with repeated questions, and is a useful method for theoretical and applied researchers needing to elicit uncertain information.

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

منابع مشابه

Repeated Judgments in Elicitation Tasks: Efficacy of the MOLE Method

Recent work has demonstrated the benefits of repeated judgments in improving the accuracy of estimates – both independent and repeated, individual judgments. The MoreOr-Less-Elicitation (MOLE) method has previously been shown to improve accuracy and precision of elicitation over single judgment elicitations (Welsh, Lee, & Begg, 2008). In this paper, we show the MOLE method delivers superior gai...

متن کامل

More-Or-Less Elicitation (MOLE): Testing A Heuristic Elicitation Method

Elicitation of people’s knowledge is a central methodological challenge for psychology, with important impacts in many technical disciplines and industrial settings. The need to convert an expert’s beliefs into a useable format is of particular importance when judgments and decisions are made under uncertainty. Simply asking a person for their best estimate or to estimate a range is subject to ...

متن کامل

Reducing overconfidence in forecasting with repeated judgement elicitation

Overconfidence is the tendency for people to underestimate the true range of uncertainty regarding unknown or future values. It results in observed outcomes falling outside people’s estimated ranges more often than their stated confidence would suggest. Previous research has, however, demonstrated various ways of reducing this bias and the More-Or-Less-Elicitation (MOLE) tool has been designed ...

متن کامل

Which Is More Prominent in Recurrent Hydatidiform Mole, Ovum or Sperm?

Recurrent hydatidiform mole is defined as episodes of two molar pregnancies in a female. Often, complete moles onlyderive androgenic nuclear genome. We described two cases with repeated molar pregnancies attempted to preventfuture episodes by performing intracytoplasmic sperm injection (ICSI) and preimplantation genetic diagnosis (PGD)to assess genetic disorders. The first pat...

متن کامل

Elicitation, Recast, and Meta-Linguistic Feedback in Form-Focused Exchanges: Effects of Feedback Modality on Multimedia Grammar Instruction

This research explores the effects of three computer-mediated feedback modalities, that is, elicitation, recast, and meta-linguistics, on the learning of English participial, gerund, and infinitival phrases among Iranian intermediate-level EFL learners. The overriding focus of the present study was to investigate whether different types of feedback given through form-focused computer-human exch...

متن کامل

ذخیره در منابع من


  با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید

برای دانلود متن کامل این مقاله و بیش از 32 میلیون مقاله دیگر ابتدا ثبت نام کنید

ثبت نام

اگر عضو سایت هستید لطفا وارد حساب کاربری خود شوید

عنوان ژورنال:

دوره   شماره 

صفحات  -

تاریخ انتشار 2011